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■ V \ Abstract 

Students read a number of passages which differed in level of familiarityj 
goodnass of stmcture, and vocabulary difficulty, anti either rated the 
comprehansibillty of each passage or answered a nimber of comprehension 
questions based on aacb pasaage. Both comprehenslbtllty judgments and 
comprehension performance were positively related to topic familiarity and good 
story structure* Vocabulary difficulty was negatively related to performance 
on the comprehension measure only* Implications for research on 
metacomprehension are dlscusaed* , * ^ 



Text Varlablas 
2 

Contrasting the Effects of Soma Text Varl.^bles 
on Comprehension and lutings of Comprehensibllity 

Research involving reading comprehension has recently begun to distinguish 
between the ability to understand (e.g-, recall and recognize information) and 
the ability to monitor one^s understanding of the text Ce*g*, judge the level 
of one's understanding) . The former has been the foeus of reading research for 
the past several decades, with investigationi into various factors as each 
Influences text comprehension (e.g,, Anderson & Freebodyj 1979; Bransford & 
Johnson, 1973| Rothkopf, 1966| Stein & NezworsJ^l, 1978)* The latter has 
recently emerged aa an area of concern to reading researchers baaed ou general 
work in metacognltion (Flavell, 1976i Flavell § Wellmanj 1977) , and more 
specif ically ^ work in metacomprehension (Brown, in press | Mafkman, 1977; 
Winograd § Johnston, 1980)* 

The purpose of this investigation is to compare the effects of variables 
at the word, discourse, and knowledge levels on a measure of comprehension and 
one of metacomprehension. We wiil first give a brief Introduction relating the 
areas of comprehension and metacomprehensian, then will define our Independent 
variables as operationalized in this study* Next, we will discuss our 
selection of dependent measures In both areaSj and finally we will describe the 
eKperlment* . 
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Relationship between Co mp r ehe n s^i on and M eCacomprehension 
The purpose of reading has been described as comprehension of the text, 
with the criterion for understanding set by the reader based on the goal of the 
reading activity (Browne in press), A multitude of factors that influence the 
reader'^s unde^^atanding of text have been identified, factors such as ability 
(Olshavskys 1976'-77; Raphael^ Winogradj & Pearson, Note l)j the use of adjur 
questions (Frasej 1968| Anderson & JSiddle^ 1975), text structure (Stein & 
NeEworski, 1978y, word difficulty (Wittrockj ^ferka^ & Doctorow, 1975)^ or 
context (Bransford h Johnaon, 1973)* The majority of this research has tended 
to focus upon text vaifiables and^ as the research has demonstrated, variations 
in characteristics of text can have a large impact on the reader's ability to 
comprehend what he or aha has read* 

The research in metacomprehension,, rather than focusing on the reading 
process Itself, investigates both the reader'^a awareness and control of the 
reading process. Awafeness of the reading process concarns a person's 
knowledge (conscious or unconscious) of His or her personal cognitive 
resources* These resources are the stable sources of information available to 
the learner regardless of the context* Cpntrol ov self^regulatory mechanisms 
are tioae less stable indices of information that depend upon both the learning 
Bttuzilon and the learner's expertise* Iherefore, it is not surprising that 
studies concerning metacognltlon have emphasised elthet Twhat readers know about 
the reading process qr \\o^ readars regulate the ongoing readln§^ process* 
Flavell (1976) 4plineates three types of varlablaa pertinent to .thyestigatlone 
into metacognitlva knowledgei (a) person .variables^, what one knows about 
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oneielf and other people as cognitive processo l .eSj 

information available during the task, or kno^ i ndsi and 

(c) strategy variables, those invoked to moni s 

. To illuminate the relationship between ad 
metacomprehansion, it seems promising to inve: " .lat way variables 

known to affect the former will influence the 

Some yariables that Influence Comp r ehens io n 
Of the many variables that can affect comprehension, three were selected 
for manipulation in comparing comprehension and metacomprehension. The three 
represent person and task variables known to affect reading comprehension* The 
first is word frequency g a task variable most likely to influence comprehension 
at the word and sentence levels* A second task variable to be manipulated is 
chat of structure, a variable likely to affect comprehension at the discourse 
"leveli that Is^ the integration of episodes into the general pattern of the 
story. The third Is topic familiarity, a person variable likely to provide 
Information about processing at the level of Interpreting the theme of the 
s^ory in terms of personal knowledge* 

The importance of word knowledge in reading comprehension has been 
recognized for some time* Correlational and f actor'^analytlc studies have 
indicated that word knowledge and verbal reasoning ability account for almost 
all the variance in standardized comprehension measur?^f (Davis, 1944, 1968; 
Spearlttj 1972; Thorndlkej Note 2). Yet, experimental studies of the effects 
of word knowledge on reading comprehension have not prbduced such clear 
results. Wlttrock and his coworkers (Marks, Doctorow, & Wittrock, '1974| 
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Wittrock, Marks^ .& Doctorow, 1975) found that passages in which 15% of the 
words had been changed to lower-frequency synonyms led to about a 25% decrease 
in performance on aubsequant comprehension questions. They also found that 
direct instruction on the rare words could increase the performance of the 
low-word-frequency group* Jenkins, Pany^ and Schreck (1978), however, failed 
to repJ icate either of these findings and found that whereas vocabulary 
training transferred to single sentences containing target words, there was no 
effect due to increased word knowledge on broader measures of comprehension. 
They suggested two possible explanations for this faixure to cransferj the 
first related to the power of the instructional methodology^ the second to the 
proposition that readers can cope with a high proportion of unfamiliar words 
without too much disruption to their understandings ^ particularly if the topic 
of a passage is familiar to them* General knowledge of the theme may allow the 
reader to construct highly plausible meanirtgs. This iSg in- effect, a 
hypothasis abouL an interaction, Word difficulty has not been related to 
comprehensibllity ratings, possibly because of. the obviousness of the result of 
a maln^effects test* Yjt ICs role in Interaction with pragmatic ^nd atructural . 
variables may not be so predictable. 

Our knowledge of how text^ are typically structured and the role of that 
knowledge in encoding, recall, and judged comprehensibility are currently the 
objects of conalderable study, particularly in the contSKt of ^simple stories. 
It has bean shown, for Instance, from recall protocols, that subjects tend to 
organize output according to a "normal" or ''ideal" structure, even when the 
stories they originally read are poorly or randomly structured, , Thorndyke 
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(1977) presented subjects with one version of a story OTltten In one of four 
waysi (a) intact (that Is, ''normal*' structure), (b) with the theme after the 
conclusion^ (a) with the theme deleted, and (d) without any causal or temporal 
continuity* Ha found that recall completeness decreased with the decrease in 
the quality of structure, as did subjects'" hit rate for true statements in a 
recognition task. He also found that the false alarm rate for similar and 
logically derivable sentences decreased as structure decreasadj suggesting 
thatj at the point of encoding, less integration of the story with existing 
knowledge had occurred for the more poorly structured stories. Stein and 
Nezworski (1978) confirmed these results and, in addition^ eKamlned the effects 
of instructions *to recall verbatim versus to "make a story," They found 
interactions between the degree of structure in the story and the type of 
inatructions. 

There is also evidence that by about age 10, school children are beginning 
to become aware of organizational aspects of texts and of their utility in 
understanding and recall (Danner^ 1976), The materials used, hibweverj were 
overly simple and did not reflect. In content or structure, the typical reading' 
experiences of the subjects. In a study by Thorndyke (1977)^ college students' 
mean comprehenslblllty ratings of texts with decreasing structure declined with 
the decrease in the quality of structure* These stories were more like the 
subjects' normal readings but it has not been shown that these effects are 
robust either for children or for passages about which subjects,. possess 
different degrees of pragmatic knowledge* . ' 
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One aspect of a readar^s overall familiarity with a topic domain is his 
knowledge about the pragmatic constraints that apply in it. It has baen 
documented that topic familiarity affects coraprehansion and recall* Splllch, 
Vesonderj Chlasi^ and Voss (in press), for example, tested groups high and low 
on baseball knowledge on their recall of a report of a baseball gar High 
prior knowledge was related to better recall of (a) the goal structure of the 
game, the Important variables and their possible values, (b) the game actions 
and their relevance to the goal structure, and (c) the sequences and state 
changes Involved in the development of the game* Anderson^ Reynolds, 
Schallert, and Goetz (1977) found that interpretation and recall of ambiguous 
passages was predictable from knowledge of the subjepts^ areas of expertise. 

Music and physical education majors read a passage which could be Interpreted 

X 

as a wrestling match or a prison break, and another about a group of people 
meeting to play either cards or musical instruments, .Subjects Introduced 
predletable background^related elements Into their recalls and many reported ' 
being aware of only one Interpretation* At a more dramatic level, Bransford 
and Johnson , i 973) have shown that a passage they wrote (about washing clothes) 
can be almost totally incomprehensible and unrecallable without the title but 
quite gaslly cbmprehended and recalled with the title. ^ Initial access of the 
relevant knowledge, in this case, provides the only framework for understanding 
and recall. ' 

To summarise thus far, we have considered three variables, from the word 
to the discourse to the knowledge level, to be of relevence and interest In 
this Inveatlgatloni the general purpose of the study was to examine the main 
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and interacting effects of pragmatic, structural, and word-leval manipulations 
of text on comprehension^ and to compare these results to the effects of these 
variables on judgments of text comprehenslbility and interest* 

Method 0 
This investigation involves two separate experiments, though in both 
studies stories and Interest ratings were identical* Therejore, for purposes 
of clarity t those features common to the two studies will be described. Then 
the materials and procedures unique to each study will reported under 
Experiments 1 and 2* 

Subjects 

^ One hundred and twenty ^eventh^grade students in six classrooms from two 
central Illiriois junior high schools participated in the study. Students 
ranged in; ability from below average (reading up to 2 years below grade level) 
to above average (reading beyond the seventh grade level). Ability leveis were 
determined on the basis of reading comprehension scores from the Stanford 
Achievement Test admlnistared in Springy 1979. The scores of students reading 
more than two years below grade level an^ thosi labeled "language dleabled" 
were not included in the data* 

An important prerequisite to the comparison of comprehension performance 

with Judgmenta of comprehenslbility is the equivalent of the two groups of 

. ff ' ... 

students- This was determined by our exMal nation of the reading achievement 
scores for the two groups. Standardized reading vocabulary (RV ) and reading 
comprehension (RC) means and standard deviations for the two groups weres 
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School A; RV; it = 59ri5 (SD « aS. 97) 

Bi RV: X = 54.07 (|D = 24.30) 

A: RCi X ^ 56,29 (|D ^ 29,11) 

Bf RCi X ^ 56.73 (SD ^ 26,74) 
^--teacs for the two comparisons indicated that the difference between means .was 
not significantly different (RVt ^ ^ -77, d£ ^ 58; RCt £ ^ *06j df ^ 58)* It 
can be assumed, then, that the two groups were of equivalent reading ability. 

Three classrooms in one junior high ichool were assigned to the \ 
comprehension eKperlmental proceduresi three classrooms in the other junior 
high school were assigned to the raetacomprehenslon experimental procedure* 

Since our pari:icular Interest in this study t/aa in the effects of text 
variables rather^ than in a given student'^s performance on comprehension and 
metacomprehenalon questions, a between^sub jects design was felt to be 
appropriate* This feature avolda practice effects and effects of serial 
desirability associated with questions on particular piecea of information 
presented In different modea* It also permits more efflclenfc^se of students' 
time, and given the assumed equivalence of the groups ^ does not impede 
interpretation of the results in terms of the variablea of interest* Within 
each claasroom^ atudancs ware randomly asalgned to conditions (order of passage 
presentationj or '*llst")* P 

Materials ' , 

Passages * Four underlying thCTes (construction, intervention of higher 
authorityi arbitration, and territorial rights) were used aa a basis for 
constructing tlie paaeages. The themes ware developed In passages of 
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approximately. 300 words in length, following Van Dijk's (1977) suggested 
macrostruc tura of exposition, complication, and resolution. The exposition 
consists of the setting Information, charactarSi and background information 
leading to the complication* The complication of an episode is "something 
surprising, remarkable^ or at least interesting" (p, 38)*^ The resolution 
Involves the solving or resolving of the problem in the complication (see 
Table 1), ' ^ 

Insert Table 1 about here 

Each theme had two Instantiations ^ one passage familiar and one unfamiliar 
to alxtlr-grade children^ with familiarity operationallzed In terms o# the 
pragmatic constraints involved In^the situation- A passage was defined as ^ 
fMlllar if the protagonists were individuals and the problem one that dealt 
with known entitles within the child^s range "of experience. An unfamiliar 
passage was defined as one concerned with more abstract protagonists such as 
corporate entities, and the ^rc'lem one of corporate interaction or 
decislon-^maklng* Thorndyke (1977^argued that cbncreteness increases Imageiy 
which facilitates comprehension* With more concrete content,, the .reader can 
attribute to the characters actions that are bLcrsotypical- of their normal 
behavior^ [ thus] extra'^experlmental knowledge could be brbught Co bear [on the 
passage]" (p. 98). It was ass^ed that children would possess less 
axCra^experlmental' knowledge of corporate entities than of individuals. The 
two passages were parallel throughout , changing only those words necessary to 
achieve the two different levels of familiarity. Without sacrificing story 
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cohaslv«nttee or meanlngf ulneas , the instantiatione of each theme were matched 
at ,t^e word level (see Table 2). * - . 

^ ' ^ « Insert Table 2 about here ^ 

' ■ ' ^ ' * 

The , structural manipulation consisted of exchanglng^the complication and 

the resolution^ In a wellrstructured itory the order of exposition^ 

somplicatlonj and resolution was preserved* In a' poorly structured story, tKe 

order was exposition, rasolutlonj and compljcation. Klntsch (1977) proposes 

that the reader brings a set of fKpectations about the structure of a story to 

any paaaage he or aha is to read. The* expectation specif Ically involves 

^ ^ / ^ ... ^ — ^' ^ ^ ' ^ ' . ' ■ 

finding the teKposition of the first episoidei followed by a complication and 

reaolutionp Wien the^order of- the complication and resolution were changed| 

^the materials we're expected to violate the reader^s set of expedtationa^ 

. y . . : ' , - ) ■ 

V" To manipulate word frequency,, 15% of the words in each passage were 
,changed# For 6xample, In the hlgh^ord^f requency version of o,ne of tha stories 
("Jrouhle Between^ Bisters") , the mean frequency index (l.e*| SFl from Carroll,^ 
Daviea, S-Mctaanj 1971) waa 62*58 ( |0 ^ 10.65), and^for the low^firequancy 
'\rer8ion the mean was 47,56 (SD » 8.48), , ' 

In summary, a tota^ of 32 different^^ passaged ii^ere develapsd based on the 
four: themes and the thr^e manipulatlona* Each theme had a familiar^ and ari 
unfmi^llar paaaage- For each passage^ there, waa a we^l^atructured and k poorly 
structured version jln both high'^ and low[^f requency words, Thua, there were 
eight posaible varaions for Jeach of the four scrlpta (aee Appendix A), 
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Intereit asgaasment * In both exparimentSj subjects Tated eaeh story.on a 
four^polnt Interest scale, ranging from "very IntMeatlng" to "not ^t all 
Intereating* " A brief explanation of the scale was given to the ktudents 
during the oral InBtructions of the eKperlment.- 
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Design 

Two ^pertoents were designed to assess the effects qf pragmatic. 
Structural, and wprd^level manipulations of tekt| comparing the effects of 
these manlpt^ations on three dependent meaiures» The measures used were 
designed to assess judgments of compreHenslblllt^ ofi text, judgments of 
performance using the teKtj and degree of' interest in the text. The variables 
tQplc tamlliafclty (familiar mnd unfamiliar) , atructure (goo^d and poor)^. a'nd , 
word frequency (high and "low) were combined factorlally to yields a 2 x 2 x 2 
experimental design*^ Topic fmalllarlty and iSttucture were varied within 
subjects, while word frequency was a between^subjects factor ^sie Table 3). 

* ' Insert Table 3 about here . ^ ' 

\ : , „^ .„ ^ ^/ ^ ^' ^ 

For purposes of counterbalancing^, a Qraeco'^Latin square was constructed 
with the four scripts or themes as rae variable^ and with the four topic 
familiarity/ structure treateent eombfliatiohs as the second variable (s^e 

' ^ p 

T^ble 3). Four lists of stories^ were constructed corresponding to the rows of 
thp square* Thus, each script was assigned to each of the treatment^ ^ 
condiAons, and also to each of the; prdiriar positions%i6hln the list. In 
totaLj^, eight lists were constructedi four eaph Jor the hlgh^ and. 
low^ord^f raquency conditions, for botli experlmentst 
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" Experiment l^i * Judgments of Comprehenaiblllty o'f Text 

Dependent Measure ^ * 

_- -M- _ • - •- ^ - ■ - ■ ^ , e * 

The dapendent jeasure consiat6d o^f two questions designed to assess the 
J subjects' cognitli^e monltorlngi (a) Judgmehts abqut the difficulty of the 
passage; and (b) predictions about performance on a test^over the story (see 
AppehdlK B for examples) » Response to the questions was measured on a^ 
four^point rating scale, Res^nses were then combined to form one dependant 
measure of cognitive, mohltorlng or judgment of comprehenslblllty • 

Procedure ' ^ / 

Sub Jects^ randoml^^ assigned to list within classroonia, were each given a 
booklet consisting of four stories followed'^^'by four Identical sets of three 
question's 'The first two were those measuring the subject's Judgment of teKt 
comprehenslblllty and individual performancei the third indicated how 
interesting the text seamed to be*^ Children were told that this study involved 
uniderdtandlng how readers decide whether a story is dilflcult or easyV and that 
they would be .asked to read some stories and rate them on two different ratings 
s*eales*. The scales were then described. Following thiSs the students were 
told to read the four storlesi then to rate each story on each of the three 
questions* While they ^re 'allowed access to the stories at all times, they 
were not encouraged to refer back to them. All children were able to complete 
the task wlthfn 30 minutes* ^ 
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Results . , , 

Praliminayy ' analy als , The first step taken In ^tha analysis of the 

metaeompreheni Ion data was determining .the intercbrrelatloni of the 'three ^ 

rating scales. Reading eAe aorrelated ,53 with prediction of test 

performanoej sug^gestlng that these two scales Involved similar kinds of * 

assassment on the part of the reader. Mueh of, this overlap may be due to the 

common method of measurement. Evidence was also found that suggested these 

kinds of judgment proaesges were distinct from judgments of interest* The 

correlations of the two factors of reading ease and prediction of test 

• ' ' ' . ■ ^ . . /. . 

performance with the factor of Interest were *23 and .28^ respectively^ These' 

findings together suggest that one metacoffiprehension score could be formed by 

combining the reading ease and prediction of test performance scores ^ and that 

this composite scale „measures something distinct from interest* ° 

Analysis off ne tacomprehension - data . ^ analysis of variance was perfo^ed 
on the composite metacomprehenslon score with llstf and word frequency as 
between"*sub jects factors and with topic familiarity and struidture as 
within^-subjects "factors. . , 

A significant main effect was fomid'' f or topic familiarity^ £(1,S6) ^ ^ 
44*95j £ < .01). There was a tendency for better structured stories to result 
In higher rated comprehenslblllty, WJil^SS) * ^ < .065)* Table 4 shows 

that In both cases residLts are in the .expected dlrectioni high familiarity and 
well-formed structure result In.ftlgher ratings* ' 
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^In the case. of structure, a discrepancy exists between ratings of reading 

ease and predictlone of test performance. For reading eastj there ia no effect 

/ ^ ' • ft* ' 

for structure, £(1,56) ^ .81 (M gpod-structura ^ 3.3S| M poor^structure ^ 

^3*24). However, for prediction of ^test performance the difference was smII 

but significant, £(1,56) ^ 4.76, £ < ,05 (Mvgo&d-structure = 3,23; M 

poor^structnre^ 3.04)* These findings suggest that story structure Influences 

a readerTs decision about how easy a^^ story is to read differently from decision 

about poislble test performance. 

Thare was a significant Interaction involving list, word frequency, and 

familiarity, PC3,56) ^ 3.80, n < .02* This suggests that the interaction of 

i ' ^ ■' ~ ■ ' ^ . ..." " , 

word frequency and familiarity depends uyon the list of stories read (see 
Table-.S). . ^ " ; _ .^v^^ . / . - "\ v ^ ' ^ -9 ^■ 
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Careful Inspection of these means reveals that ik all lists but Number 4, 
Iw^frequency stories result In lower ratings than do high-frequency stories 
when the topic is familiar. Also, in all lists but Number 3 , there Is IJttle 
difference in mean ratings bltween hlgJ^and^ low^ord-f requency' stories with 
unfamiliar topics. Note, howeverj that this suggested 4nteractlon where word 
frequency has an effect only with familiar topic atorlea is comp^tely true 
only for Lists 1 and 2« These data suggest that the word frequency by topic 
familiarity Ititeractlon dfpepds upon the level of a third variable for which 
the present reseach has not aontrblled. ' ' . ' . 
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The lack of a main effect foe wotd frequencyi ^(1,56) ^ ,73, or an 
interaction batween word frequency and topic familiarity was Initially 
surprising* This result was probably due to the nature of the factor in this 
particular design* M a between-^subjecta factor, it was difficult to establish 
the effect of word frequency* since a rtlatlve rating scale was used. Subjects 
would not likely be' made aware of the factor and would thus be unlikely to take 
it into conalderation, . ^ 

, Experiment 2% Comp r ehen s io n Performance on Probe Questions 

Dependent Measure " . ^ 

Ten multiple^choice "questions were developed for each ato^* Five 
questions probed geheral recall for textual Informatlohj three assessed 

knowledge at the word level, and two measure'd beyond*the^text knm^ledge of the 

* - . * ,^ , 

topic* . In one case of the topic-knowledge assessment^ a distractor was . 

% . ' ^ " ' . ..... . " . * ■ 

designed to highlight the effect of the structural manipulation (see 
Appendix B)« ^ ^ ^ 

Procedure ' ^ . ^ 

Students were tested^ by "classroom, each student using a test booklet ^that 
consisted of four stories. Each story was followed by an interest rating and 
the "ten appropriate probeb. Access to stories was not permitted during the 
students' response to the probes. Once the initial oral instructions were 
glveni students worked Individually at their preferred pace. The task took' 
approKlmately 40 minutes « 



Text Varlableg 

' ' ^ , ' / 17 

Results ' ' 

The tan multiple^cholce compreheneion questions were deilgned to assess 
recall of detail lnfotmatlo\i, understanding of vocabulaty, and the inferences 
drawn, using flvcj three, and two questions for each respective category . In 
order to obtain an overall eotaprehension score that reflected equal 
contributions of the three kinds of Informatlonj g^scores were computed for 
each of the ten Items. These scores were then averaged within question type 
and then averaged again to yield an overall comprehension score (see Table 6). 



Insert Table 6 about here 



The control variable list was^ omitted, slnci an Irtltiai analysis of variance 
showed'lt to have no effect. Analysis of variance with word frequency as a 
between-subjects factor and familiarity :and structure as wlthln^subjectd 
factora revealed no Interaction affects or even "trends In the expected 
direction." Main effects were found for topic familiarity, word frequency, and 
text structure (see Table 7). ^. , ^ 



Insert Table 7 about here 



Hlgh^word^f requency stories resulted in better comprehension, f ^ 18.21, 
£. ^ *01. Stories about more- familiar topics were comprehended 'slightly better 
than those about less familiar topics , F(l,56) =10.28, £ < *01. There was 
also a slight advantage In comprehension for storieis wlth'good structure as 
compared to those with poor structure, £(1,56) ^ 4.09,\j| < .05. 
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Because these effaets wer^e small, it was/declded to examine the ddfa more ^ 
closely to see^ If the .effects of wrd frequency toplG familiarity, and, 
structure were different In any way for good and poor readers* Good and poor 
readers were .defined by their performances on the Stanford Achlevment Reading 
Test (Total Score) • Good readers scored In the top quartlle and poor readers 
in the hottoDi quartlle based on national norms. 

Inspection of these means suggests that there was little effect for topic 
familiarity for poor readers, and no effect at all for good readers < Word 
frequency appeared to have a uniform effect for both ^types of ^readers« There 
was, however, the suggestion that structure does affect poor readers and good 
rearfera differently. Poor readers seemed to be advarsely affected by the 
poor^structure condition, while good readers seemed t© be relatively 'unaffected 
(see Table 8). ' ^ ^ 

Insert Table 8 about here - 



These reading ability by treatment Interactions were tested with " 

regression analysis* Neither Interaction suggested rf ached slgnif Icancei 

. - ^ . . r . /'V ■ • ■ \ ; - V ' . : ' ~ ' ... . 

topic familiarity x ability, K(l,231) * 2.49, £ < .12| structure k ability, £ 

(1,231) - 1.13, £ < .29* . . ; 

' One Inference question was daslgned be particularly sensitive to the 

structure manlpiilatlon* A subject's choice of one dlstractor Indicated that 

comprehension, had been Jjspalred by exchanging the story resolution and 

complication. Choice of this dlstractor can be considered a second dependent 

meas.uri* 
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. toalysla of variance on this variable resulted in only a trend toward 

significance of a main effect for structure^ F(l,50) = 3.48, £< ,07. The 

poor^atructure condition had a mean .of *128 versus a mean of .062 for the 

good^structure condition. 

, ■ . ■ ■ / . 

To see if there was any reading ability by structure Interaction, analysis 
with reading ability a^^a factor was performed. There were no differences 
'between poor and good structure stories for the good readerSi but differences 
did appear for poor readers (see Table 9)* 

Insert Table 9 about here . 

In this case, regression analysis revealed a reliable ability by structure 
interaction* The reading ability x structure interaction Increased the 
proportion of variance accounted for, FClj23l) ^ 5i29, p < .05* The simple 
correlations between the dependent variable and reading ability were ^.149 for 
good structure and ^*360 for poor structure, the latter correlation significant 
at p < .01. ThuSi the interaction was essentially ordinal in form, as 
suggested b^r the eKtreme groups comparisoh. 

' G^nsral Discussion 

Co nc lu s long , ' . 

Baaed on the combined results of Experiments 1 and 2, it seems obvious 
that tha factors of topic fmlliarity, text structure^ and word frequency 
affect students' performances on. measures of comprehension and of 
metacoffiprehansion in highly slmLlar- manners, and In expected directions. On 
both measuresi scores were higher, for passages using familiar tqplcs and good 
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^atructure. On the comprehanslon %easure| students'* 'performances were higher in' 
the hlgh^word-frequeney condition. In addition, good raadera tended to score 

..higher on the camprehenslon ^obe questions than did poor readers^ 

An Ihte^eatli^ result can be observed in the, data from %h4 dlitraetor item 
on the aompr^henalon Inference proba* Recall that choice of one dlatractor was 

, Indicative of confusion that would be predictable baaed on the poorly 
structured text. Poor readers were affected to a greater degree than the good 
readers, as evidenced hy their tendency to select the" dlstractor item* 

Future Reaearcti ' 
i f. '* 

There are two toplicatioris for future research that follow from tho , 

previous studies. The first concerns the need to Irtvestlgate the ability to 

comprehend and the ability tcperfom successfully on metacdiiprehension^ tasks 

- j " 

within anr Individual reader i The second Is concerned with a possible 
methodology for Identifying points at which material ceases to*be 
oomprahenslbla. 

These studies ea-tabllsh a connection between performance on comprehension 
and on metacomprehensipn tasks. However, ^ there is a definite need to specify 
the nature of this relationship, Wliile It Is Intuitively clear that there 
exists a good^poor reader distinction on both measures, there Is no indication 
whether this distinction is stable across the t\m measures. That is, what now 
needs to be dmonstrated is whether a good comprehender Is also a good 
metacomprehender ^ a poor cofliprehender , also a poor metacofflprehander , or whether 
the reality la that the. two skills are not consiptent within a single reader* 
While we predict that in the majority of readers the correlation between 
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maasuras of aomprehension and metacomprahenslon would be hlghj it ie not 
unreasonable to axpect to find s'omdone who is unable to eomprehend a passage 
and to be: quite aware of any inadequacy ^ or for aomeonR to think that, they are 
quite unable to -read and understand a passage^ yet be able to eKplain it 
adequately at a later time. 

The second Implication o| this study is pethodological. The success of 
the distractpr item on the multiple^cholce comprehension probes indicates that 
this may be a means for specifying exact points of breakdown in comprehension. 
Tn addition to Identifying a location In the text that serves to confuse the 
reader. It can also help identify the ways in which the reader may become' 
confusedj yet not turn to a *'flK^up" strategyp By selecting a specific 
dlstractor itm^over the carrect answer^ the reader is Indicating^ exactly what^- 
type of inference was required to make sense of the te^t. » . . 

These stales have served as an exploration Into the area of text and 
reader variables as they Influ^ce the reader'^s abilities tp understand a 
passage, as well as recognize any coffimunlcatioii breakdown during reading. 
While there is much to explore. It seems reasonable to conclude that although 
tw^ constructs^ comprehension and metacomprehenslon, exist, there 'is a great, 
deal of overlap between the two* This is ^perhaps due to the role of the 
"executive" In cognitive functioning, to the, similarity in task demands, to the 
necessary integration of the" two by tfie successful reader, or to any number of 
variables not yet considered. Future research should, concern Itself with 
identifying where the overlap lies, and what Implications this information has 
for the fieldil of psychology and education* ' ^ 
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Appendix ki Stories 

Theme 1 ^ Construction 
Structured - High frequency Familiar 

The Treehpuse 

There were two things Mary had always wantad - a plac« to be alone 
and a place that was for bird watching* Her family was now renting a 
hoine '^In a big city. Mary decided that there was one way she could gfet 
both of these thingi*. In the back yard away from the houses, they had a . 
large tree. She made up her mind to build a treehouse iir that tree. 
That way she could do the things she wanted and Have a pleasant plac0 
to 'watch birds. * . ^ " ' ^ ' . 

Clearly she cpuld not build it on her owns ^o' she talked to her 
brother an,d some of his |rlendS| and some o£ her oto friends* Soon 
they got all the materials together and the building began. 

When the building was about a third of the way through ^ Mary's 
parent's came out to look at what was happenings Iimediateiyi her parents 
said that, the building would have to stop because the tree was untouched 
and very beautiful. They said that people cltabing up and down would 
ruin the life of the tree after a while, 

. ^ ■ [ 

Mary did not know what to db^ One of her friends said that they 
could change the treebpuse Into a blrdhouse to- feed large ntmbers of 
birds. In this way J once the building was finished^ no branches would^ 
be broken. She decided^ to do this , and soon the building was finished, 

^ ' • 

Things turned out even better for Mary because she enjoyed herself 
even more by watching all the birds that came into the tree more regularly, 
and. she could watch all alone ^ on the back porch. 
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. Theme ,1 - Construction 
Structured - Low frequency - Familiar 

The Treahouse 

' ^ ' There were two things Mary had perpetually wanted==a place to^be 
alone and a place that was for bird watching* Her family was currently 
leasing a home in a sizeable city. Mary ascertained that there was one 
way she could attain both of these things* In the backyard away from 
the house, they .had a substantial ^ tree* She was determined to construct 
a treehouse in that tree. That way she could do the things she wanted, 
and have a salubrious place to watch birds* 

ObviQusly she could not construct it singles-handed, so she consulted 
her brother and some of his companions, and some of her own companions. 
Soon they gathered all the materials together and the: construction 
commenced * ^ ^ '■ ^ 

When the construction was approximately a third of the yay through, 
Mary's parents came'' out to examine her progress* Unhesitatingly , her 
parients declared that the construction would have to cease because the 
tree was pristine and very splendid. They claimed that scaling up and 
down would devastate the life oi the tree .eventually * ^ 

Mary did not know how to react. One of her companions suggested 
that t^jsy could modify the treehouse. into a bird house- to feed large 
numbers of birds* In this fashion, once the construction was completed, 
no branches would be broken. She- opted to do^this, and soon construction 
was completed. ' ^ 

^Things eventuated even more favorably for Mary since she enjoyed 
herself even more by watching all the birds that came into the tree 
more regularly J and she could .watch all alone on the back porch* 
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Theme 1 ^ Construction 
Unstructured High frequency - Familiar ^ 

The Treehousa 

There were two things Mary had always wanted = a place -to be alone 
and a place that was for bird watching* Her family was now renting a 
home in a big city, Mary decided that there was one way she could get 
both of these tftlnge* In the back yard away from the houses they had 
a large tree. She made up her mind to build a treehousa In that tree. 
That way she could do the things she wanted and have a pleasant place 
to watch birds. , 

Clearly she could not build it on her oTOj so she talked to her 
brother and some of his friends, and some of her owi friends. Soon they 
got all the materials together and the building began, 

Mary did not know what to do* toe of her friends said that they 
could change the treehouse into a birdhouse to feed large numbers of 
birds. In this way* once the building was finished , no branches would 
be broken. She decided to do this, and soon the bulldtng waB finished. 

Things^ turned out even better fbr Mary because she enjoyed herself 
even more by watching all the birds that catne into the tree more 
regularly s and she could watch all alone = on the back porch. 

When the building had been about a third of the way through, Mary's 
parents had come out to look at what was happening* IiTOediatelys her 
parents had said that the building would have to stop because thfe tree 
was untouched and very beautiful. They had said that people climbing 
u^^ and down would ruin the life of the tree after awhile. 
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Thema 1 « Construction 

^Unstructured - Low frequency.^ Faniiliar 

The Treeliouae ^ 

There were two thinga Mary had perpetually wanted—a place to be 
alone and a place that was for bird watchlngi Her fatnily was currently 
leasing a home in a sizeable city* Mary ascertained that there was one 
way she could attain bpth of these things. In the backyard away from 
the house 5 they had a substantial tree. She was determined to construct 
a treehouse in that tree. That way she could do the things she wanted, 
and have a ^lubrious place to watch birds* 

Obvioulgly she could not construct it slngle-'handed , so she consulted 
hf^r brother and some of his companions , and iome of her own companlona. 
foon they gathered all the materials together and the construction 
CQiranenced, ^ .. . ^ - 

Mary did not know how to react. One of her companions suggested 
that they could modify the treehouse into a bird house to feed large 
numbers. of birds. In this fashionj once the construction was completed, 
no branches would be broken* She op^ed to do this, and soon construction 
was completed, - 

Things' eventuated even more favorably for Mary since she enjoyed 
herself even mora by watching all the birds that came into the tree more 
regularly, and she could watch all alone on the back porch* 

V ^ ^ - , _ 0 

l/hen the construction had been approKimately a third of the-way 
through J Mary's parents had come out to examine her progress. Unhesi- 
tatingly * her parenti^^ad declared that the construction would have 
to cease because the tree was pristine' and v^ry splendid* They had 
claimed that scaling up and do^ would devastata the life of the tree 
eventually. . 
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Theme 1 ^ Construction . 
Structurad ^ High frequency - Unfamiliar 

The New Factory 

There v^ere two things the Poly Plastic Bag Company had always 
wap.ced = a factory of its own and offices that were out of the city. 
They were currently renting a factory in a big city when the company 
decided that there was one way they could get both of these things. 
Near a quiet river out of the city, they owned a large block of land. 
They made up their minds to huild a factory on that land. That way 
they could do the things they wanted, and have a pleasant place to 
work, . 

' Clearly they' could not build it on their own^ so they talked to 
a builder and some of his associates, and some of their own employees. 
Soon the materials had been gathered and the building begun. 

When the construction was about a third of the way through , the 
Pollution Control Board dame out to look at what was happening, 
Inmediately the Pollution Control Board said the building would have 
to stop because the river was vary old and beautiful. They said that 
the waste from the factory would ruin the beautiful river 'i life after, 
a whila^i . 

The company did not know what to do* .One., of the workers suggested 
that they change the factory into a /storehouse ^o.keep large numbers 
of bags. This way'once the building was finished* no waste tBaterials 
would be produced, .They decided to do thlp^ and soon the building 
was fdnished* \ "" ' ^"^ 

Things turned out even better for the company because they could 
save money by producing -a large number of bags and storing them in 
the warehouse for future splits, and that w%s really the most important 
thing. ' 
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, ' Theme 1 - construction 
. Structured - Low frequency Unfamiliar , ^ 

The New Factory 

There were two things the Poly Plastic Bag Company had perpetually 
wanted—a factory of its own and offices that we^e out of the urban area. 
They were currently leasing a factory in a slEeable city J The company 
ascertained that there was one way they could attain both of these things. 
Near a quiet river oufi of the city they owned a subatantial block of land. 
They determined to construct a factory on that land. That way they could 
do the things they wanted and have a salubrious place to work**' 

Obviously they could not construct it single-handed, so they consulted 
a builder and some of his associates and some pf their owa employees. Soon 
they gathered all the materials together and cpnstructlon coraienced, 

When the cgnstruction was approximately a third of the waSr through , the 
Pollution Control Board came out to eKaralne their progress* Unhesitatingly, 
this board declared that the construction would have to cease because the 
river was pristine and ve^ splendid. They claimed that effluent from .the 
factory would devastate the life in the river eventually. 

The company did not know how to react. One of the employees suggested 
that they could modify the factory into a warehouse to keep large numbers 
df bags^i In this fashion, once the construction was completed, no effluent 
would be produced* They opted to do this, and -soon the construction was 
completed* 

Things eventuated even more favorably for the company sii^ce they saved 
money by producing a large number of bags more regularly and keeping them 
in the warehouse for future sales, and they moved their offices but of the 
clty"to the warehouse, ' ^ ' 
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Unstructured High irequancy - Unfaailliar 
i ' The New Factory 

1 There were two things the Poly Plastic Bag Company had always 
wanted"a factory of its owi and offices chat were out of the city, 
Th'py were currently renting a factory in a big city when the company- 
decided that there was one way they could get both of thfaae things* 
Near a quiet river out of the city ^ they owned a large block of land. 
They made up their minds to build a factory on that land. That way 
they could 'do the things they wanted ^ and have a pleasant place to 
work,. . . , _ 

Clearly they could not build It on t-helr own, so they talked to 
a builder and some of his associates , and some of their own employees,. 
Soon the materials had been gathered and the building begun J 

The company did riot know what ^ to do. ' One of the workers 
suggested that they change the factory into a storehouse to keep large 
numbers of bags. This way once the building was finished^ no waste 
materials would be produced. They decided to do this, and soon the 
building was finished ir 

Things turned out even better for the company because they could; 
save money by producing a large nuaber of bags and storing them ^n 
the warehouse for future sales, and that was really the most Impprtant 
thing. 

When the construction had been about a third of the way through, 
the Pollution Control Board had come but to look at what was happening 
Iimedlately, the Pollution Control Board had said the building would j 
have to stop because the river was very old and beautiful. They had 
said that the waste from the factory would ruin the beautiful river's 
life after a while. 
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Theme 1 - Construction 
Unstructured - Low frequBncy - Unfamiliar 

The New Factory 

There were two thi^igs the Poly Plastic Bag Company had perpetually 
wanted— a factory of its, own and offices that were out of the urban / 
area. They were currently leasing a factory in a siaeable city. The 
company ascertained that there was one way tihey could attain both of 
these thlngSt Near a. quiet river out of the city they oxmed a sub^ 
stantial block of land* They determined to^ construct a factory on 
that land. That way ,they could do the things they wanted and have a 
salubrious place to work. 

Obviously they could not corsStruct it single-handed^ so they 
consulted a builder and some of his associates and some of their own 
employees. Soon they gathered all the materials together and construction 
commenced. 

The company did not know how to react* One of the employees suggested ? 
that they could modify the factory into ^ a warehouse to keep large numbers 
of bags. Id this fashions once the construction was completed, no effluent 
would be produced. They opted to do this, and soon the construction was 
completed. ' ^ * fiS 

Things eventuated even more -favorably for the company since they 
saved money by producing a large number of bags more regularly and keeping 
them in the warehouse for futjure sales , and they moved their offices out 
of the clty™to the warehDuae. , " 

When the construction had been approximately a third of the way through * 
the Pollution Control Board had come out to examine their progress. 
Unhesitatingly J this board had declared that the construction would have 
to cease because the river was pristine and very splendid^ They had 
claimed that ef fluent -^from the factory would devastate the life in the 
rlver^eventually . 
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Appendix B I Questions 



STORY TITLE 



(1) How easy did you find this story to read? 

very easy 

^ pretty easy 

pretty hard 
very hard 

(2) How well do you think you would do on a taet on this atoryl 
^ very well ^ 

' pretty well ^ 

pretty poorly 

^ very poorly 
*? . 

(3) How INTERESTING do you think this story was? 
• very interesting 

pretty interesting 

not too interesting 
\ , not at all interesting 



/ 
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LfUf 

FACTORY 

1. One of the thtngs the Poly Plastic Bag Company wanted was 

a* offices downtown 

b. new equipment for their factory 

c^ offices in the country 

d* a change^ in zoning laws 

2, The company was originally located 

a, in the suburbs , : 

b, at the edge of town 

c, in the city 

d, near a river 



The company's building plans were changed 

a« before construction began 

b* when they were one thltd finished 

c. when they were one half finished 

d. when the building was nearly completed 

The building was stopped because 

a. there was a complaint about the noise 

b. tim building was unsafe for working 
c# the factory would spoil the river 

d- the company had failed to get a building permit 

The new building plan 

a. was designed to store plastic bags 

b* made the factory safer to work in 

G* changed the location of the factory 

d* was suggested by the board of directors 
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LfUf 



la the sentence ^ "There were two things the Poly Plastic Bag Company 
had perpetually wanted^" the word "perpetually" means 

a* often 

b* constantly 

c. seldom 

d* from time to time - - ' 

la the sentence, "The construction was approximately a third of the way 
through," the word "construction" means 

a. act of explaining 

b* planriing . 
c* act of making a structure 

d. group of architects 

in the sentence, "Things ■ eventuated even more favorably for the 
company," the word "eventuated" means 

a* tried 

ended early 
c* began 
d* resulted 



It was necessary to change the purpose of the building because 

a. the builders refuped to complete the original plans 
b* the company no longer wanted a factory 

c* it was necessary to preserve the enviroment 

d* the company couldn't find the neceesary materials 

The f Dilution Control Board could force a change in the purpose 
of the building because ' 

a* factories do not toow how to build a building properly 

b. buildings would not look proper neKt to rivers 

c. the Pollution Control Board has the right to stop 
buildings if they are hamf ui to the enviroiment 

d. often factories have too many buildings ^d do not 
need to build another one ■ 
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HfF 

TREEHOUSE 

1. One of the things Mary had always wanted was 

a, a house downtown 

b. new furniture for her room 

c. a place to be alone 

d* a place to share with her friends 

2. Mary's family lived 

a* in the suburbs 

b# at the edge of town 

c* in the city 

d, near a river 



3^ Mary's building plans were changed 

a, bef or eeonatruct ion began 

b. $ when she was one-- third finished 
c* when she was one--half finished 

d* when the structure was almost complete - 

4, The building was stopped because 

a. there was a complaint about the noise 

b. the treehouse was unsafe 

c, the treehouse would spoil the tree 

d, ^ Mary had failed to ask permission to build 

5* The nm? building plan 

a* was designed to feed many birds 

b. made the treehouse safer to cllJfib to 

c* changed the location of the treehouse 

d* was suggested by her parents 
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In the sentence^ ''There were two things Mary had always wanted the 
word "always"" means 

a. often 

b. eons t ant ly 
c* seldom 

* d. from time to time 



In the sentence J "The building was about a third of the way through j" 
the word "building" means ' 

a, act of eKplaining , * 

b. planning , < 
e. act of making a structure 

d. group of architects 

In the sentancej "Thfngs turned out even more favorably for Mary^" the 
words "turned out" mean 

a, tried 

b* ended early 

began ' - ^ 

di resulted 

It was necessary to change the purpose of the treahouse because 

a. Mary's hslpers refused to complete the original plans 

b* Mary no longer wanted a treehouse 

Ci it was necessary to preserve the enviroMent 

d, they lost the original plans ' ^ ' 

/ - - ■ ^ 

Mary's pareiits could force a change in the purpose of the building 
because 

a. children do not know how to build a building properly 
b* buildings would not look proper in trees 

c. parents have the right to stop buildings if they are harmful 
^to the enviroment ^ 

d. children hmve too many^ treahouses and don't need any more 
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' ' Table 1 






Story * Variables 






THEME li ^Construction 




^EKposltlon ' 


» Complication 


^ Resolutdon 


1* Main protagonists 


«1* , Outside agency 


Construction 


with goals of a 


requirep change , 


continues » but 


new building 


' in original 


' purpose of the 




plans _ . 


, ^ final structure 


2, . Prptagoaiet c 




is changed to 


engagas help 


2, Damage to' - 


t ' accoimodate 


to construct 


ahvirotment by 


^ enviroiraental 


; building 


eonstrucf ion 


restrictions 



3. Projeot is alpost 
completed 



* 



Table 2 



Manipulation of Pragmatic Cpnstralrits 
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THMl 1 1 

■ ./ ■ 


Construction* 




\-' EKposltioji 


Complicatibn . 


Resolution 


Familiar: 1. Mary wants tree-*^ 1, 
/ house to« watch 
birds 1 get out 
- " of the house In 
« • the city 


Parents said it 
could not be 
finished as 
. planned 


Tree house 
changed to 
becoine' a 
blrdhouse 


. . ■ ' . 2. ^ 
2,. Brother^j siattera, 
• r friends help build 
^ the treehpuse 


Tree was being 
damaged by nails 
and children 
climbing it 




' 3.. Project is 2/3 
^ completed p . 

^ 







Unfamiliar I 1, 



Poly Plastic Bag 
Co* wants factory 
with more space 
and away from the 
urban area 

Contractor hires 
personnel to 
build the factory 



3, project is 2/3 
completed 



EPA stopped con- 
struction as 
planned 

River was being 
polluted, wild- 
life destroyed 
by construction 



Factory changed 
to become a , 
warehouse ^ 
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Graeco^Latin Square Used In Gonstruqtlng Materials 



Script 1 
Poor Structure 
Pamlliar 



Script 2 
Good Structure 
FOTilllar 



^Script 3 
Poor Structure 
Unfamiliar 



Script 4 
Good Structure 
Unfamiliar 



Script 3 
Good Structure 
*FamiilOT 



Script 4 
Poor Structure 
Familiar 



Script 1 \^ 
Good Structure 
Unfamiliar 



Script 2 
Poor Structure 
. Unfamiliar 



. Script 4 
Poor Structure 
Unfamiliar 



Script 2 
Good Structure 
Unf miliar 



Script 3 
Good Structure 
Unfamiliar 



Script 1 
Poor Structure 
Unf^iliar 



Script 2 
Poor Structure 
Familiar 



Script 4 
Good Structure 
^ F^iliar 



Script 1 
Good Structure 
Fmillar 



Script 3 ^ ^ 
Poor Structure 
Familiar 
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Table 4 

Means and Standard Deviations for Main Effecta 



Condition 


Mean 


Standard Deviation 


Unfamiliar 


6.13 


1.10 


Familiar 


6,84 


• .98 . 


Poor Structure 


6.38 


1.15 


Good Structure^ 


6.59 


1.04 


Low Wo^d Frequency 


6.41 


1.11 


High Word Frequency 


6.55 ' 


1.09 • 

C - - ■ : = J 
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Table 5 

Means for List x-Word Frequency K Familiarity Intertctlon 



Word Frequency 



Low High 



M SD M SD 



List 1 



Unfamiliar 5.88 1.20 5.63 1.09 

I Familiar 6.19 ,54' 7.25 ,77 

J ■ . ' & 

List 2 



Unfamiliar 6.75 1,18 6.44 .96 



Familiar 6.25 1,39 6.69,' .79 



List 3 



UnffflnlUar 5.75 1.00 6.31 1,08 

Familiar 7.13 .89 7.50 .73 



■7^ 



List 4 



Unfamiliar .6.19 .91 6.06 1.12 

Fanlltar- 7.19 ' .75 6.56 .96 
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Table 6 

Maws and Standard Devlatlone for All Condition^ 



Structure 



Low Topic Faffilliarity High Tople Ffflilllarity 



H SD M |D 



Low Word Frequency / 

- — " 



Poor -^.3349 .4667 -,1644 .4814 

Good -.1968 .5627 .0303 .3466 

High Word Frequency 

Poor .0695, .6132 .1650, .3807 

Good .1309 .4546 .2772 .3730 
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Table 7 

Means and Standard Deviations for Main Effects 



Condition 


Mean 


- * 

Standard Deviation 


' Low Word Frequency 


-.1664 


.4826 


High Word Frequency 


.1606 


.4656 


9 

Low Familiarity. 


' -.0828 


.5556 


High FaiBliiarlty 


.0770 


.4268 


Poor Structure 


-.0662 


.5245 


Good Structure 


- .0604 


.4696 
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Means for Reading Ability KTreatmant Interactions 



Poor Readers (N ^ 9) Good Readara (N ^ 20) 



M SD . M ^ . SD 



Low Word Frequency ' -.6004 ,4319 / .0643 .3638 

High Word Frsquency -^.1502 .5340 .4668 .2360 

' . i • 

Low FMlllarlty -..4916 • .5772 .2270 .4106 

High Familiarity - -.3090 .4639 • .2638 .3301- 

Poor -Structure -.4895 .5936 .2085 ' .3560 

Good Structure - -.3110 .4437 ' .2823 .3856 
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fable 9 

/ - . 

Complication Distractor Scores as a Function of 

/ ■■ ■ 
Reading Ability and Structure 



Struatura/ 



Poor 



Good' 

/ 



Poor Readers 



M 



SD 



.3889 .5016 
lee? ,3835 



Good Readers 



M 



SD 



pd25 ,1581 
,025 ,1581^ 
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